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Even though modern methods of. teaching empha 




listening and speaking, seldom are students of English tested i>- a 
standa:pdized way on their ability to communicate through these 
skills. Many people learn to communicate well enough to conduct daily 
affairs in a new language, yet are: unable to read, write, or speak 
any educated form of it. They are often required to take tests 
designed for native speakers or for foreign students entering 
colleges and universities in the United States. Such tests are 
inappropriate and too difficult for most students enrolled in adult 
school SSL (English as a Second Language) courses. These students 
need tests designed and developed on adult school ESL students. They 
especially need tests that ineasure th^ir ability to understand and 
communicate orallyr-even if^-iTia:ccurately. This paper describes the 
development and field ^tj^sting of an oral i^nterview designed to assess 

\oral communication a contextual setting; While the test is easy to 
administer, examiners must become familiar yith its uniqueness. It is 
hoped that the interview will be useful to ESL programs, basic 
education programs, industry, and employments agencies in more 

_oblectively assessing foreign and second Ian i^uage speakers* oral 
levels of English proficiency. (Authox|) 
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Assessing 0 ra 1 Commu n i ca t i on In 
Adult Program English Second , La nguag e Classes^ 

Even though modern methods of teaching emphasize listening 
and speaking, seldom are students of English--or any languages- 
tested in a s ta nda rd i zed way on their ability to communicate through 
these skills, Many people learn to communicate well enough to 
conduct daily affairs in a new language, yet are unable to read, 
wri'te or speak any educated form of it:. If they enroll in an adult 
school, they are often required to take tests designed for native 
speakers or for foreign students enter i ng col 1 eges and universities 
In the United States. Such tests are inappropriate and too 
difficult for most s t u d en t s e n ro 1 1 ed in adult school ESL (English 
as a Second Language) courses. These students need tests designed, 
developed and normed on adult school ESL students. They need 
d i ag nos t i c t es t s , oral comprehension tests and now with the empha- 
sis 6n reading, in federally funded programs, they need reading 
compr ehens i c^n tests. They especially need tests that measure 
their ability to understand and communicate orally--even if inaccu- 
rately. (Lane, 1973 p» 66), 

Native Speaker Tests 

Primarily because of an erroneous yet pe r s i s t e n t no t i on- t ha t 
attainment of literacy or elementary education in English is the 
same as. the acqii i s i t i on of 1 a ng uag e , a 1 1 emp t s are made to test 
students in adult ESL or ABE (Adult Basic Education) programs wrth 
nati.v'e speaker tests which assign th'em to native speak i ng ch i 1 d- 
ren's grade levels, (Tsou and McKay, 1971 and City of Oakland 
1 975 p. 2^, Lane 1973 p. Sk^) 

Assigning foreign speakers to children's grade levels based 
on education in the United States is totally inappropriate. It is 
harmful and misleading. Too often It is assumed that If people 
cannot speak or read English, they are stupid, slow, and under- 
educated in any language. It Is also assumed that when adults 
cannot speak and read English well enough to take native speaker 
tests designed for children (even if rewritten for adults), they 
are sloworjazy or cu 1 tu ra 1 1 y xdepr I ved as well as uneducated. 
The truth Is that these adult stude^nts (often well educated In their 
own language and possessing deep cultural qualities) j u st^ haven't^ 
been exposed to enough English to take the native speaker test s • 
They, should not take native speaker tests before they have reached 
the upper intermediate adult ESL . prof-i c i ency level (see Table 1 
n ex t pag e) • 



Whis paper is an updated revision of a paper 'e'nt 1 1 led ''Placing 
Adults in ESL Classes by Guess or by Test?" presented at the TESOL 
Convention In New \0 r 1 ea n s , Ma r c h 3*7f 1?71. Parts were edited by 
VIckl Spandel for the publication MESL CI I ent Assessment compiled 
by Alicia 0. Ramirez for Western Area Manpov/er Institute, 1975, 
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After students reach intermediate levels they can take some 
tests designed for native speakers. If students do not have a fifth 
grade education in any language, or if students desirje to get a 
GED or some other U.S. educational certificate, they may need to 
be placed into'reading or mathmatics levels in an adult basic 
education program, Some unwitting employers require minority 
applicants to take tests designed for native speakers that are 
based on children's grade levels, Upper intermediate and advanced 
level students may want the practice of taking this type of test 
(Karlsen, Madden and Gardner, 1967i and Tabe, l967i and Thurston, 
1969). 

College P'oreign Born Tests 

Sometimes adult students are given tests designed for college 
level foreign students who have studied English for majriy years 
before coming to the United States. These tests usually do possess 
language prof i c i ency ra t her t ha n a s s i g n i ng persons ♦'O children's 
educational grade levels in the United States, The tests, however, 
set standards of readiness for entering colleges, universities or 
Intensive English programs which prepare foreign students for 
college work in the United States. Even when adult students have 
high school diplomas from other cou n t r i es - -o r for that matter, 
college or universi.ty degrees--if they have had little or no 
exposure to English, they cannot understand or read- enough English 
to take tests designed for foreign-born college students. (Harris 
and Palmer, 1971; Pillsbury, Thrasher anjl-UpsTi'urV " 1 963 ; and Upshur, 
Palmer: and Harris, 1961-196^.) -"'"'^ 

Colle.ge level forejgn student tests are too difficult. They 
do not establish any realistic g u i d e 1 i n es f o r beginning adult stu- 
dents, (See Table K) \Fo r examp 1 e^, on TOEFL (Test of English 
as a Foreign Language), many students who are quite capable of 
surviving and c^mmu mi ca t i ng orally in English would receive a n i 1 
proficiency rating. This dpesn.'t give us much i nformat ion • Per- 
haps we need ri i 1 1, n i 1 2, n i 1 3, etc, * 

What TOEFL considers elementary proficiency, v/e in adult 
programs cons ider an indication df readiness for intermediate 
adult instruction. This means either 1) entrance into a basic 
education program if the student's educational level is below 
fifth gra^^e in his native language; or 2) continued ESL instruction 
combin^ed with vocational or academic instruction to bring English 
'ability up to other educational skill levels, > 

Need for Special ESL Tests for Adult School Programs 

Many students in adult ESL classes study to acquire a working 
knowledge of English that will enable them to deal with everyday 
life, to find employment,"and to upgrade their employability skills. 
Many of these adults in ESL c 1 a s s es - -beg i n n i ng through advanced-- 
have college and university goals, ^ 

Until students reach Intermediate and advanced levels in 
adult ESL proficiency programs, however, attempts topJace them or 
to demonstrate their achievement through inappropriate and difficult 
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tests Is threatening, harmful and extremely misleading. Beginning 
adult ESL program students fear inappropriate and difficult tests, 
and often will not return to class if these tests are given. What 
Is, seemingly overlooked is that anywhere from 60 to 80 percent of 
students enrolled in adult program ESL are in^ these begi^nning levels 
of proficiency (llyin, 1971 and 1976 a nd I 1 y i n^ Bes t a nd Biagi, 
.1 972). These students need^' tes t s -t ha-t do not fri^jhten them, that 
do not ask them to read something they do not understand, and 
that give practical and realistic results. They especially need 
tests that measure understanding and speaking ability. 

ft ' ' . 

As a n a 1 t er na t i ve to inappropriate and difficult tests,, tests 
that require reading, or {he r e gu es s wo r k , I have developed a 
controlled oral i n t e r v i ew- - he r ea f t e r referred to as the. "llyin Oral 
I nterview''--which places students by testing t he i r, a b i 1 i ty to 
answer and a_sk qxreSXi o ns o r a 1 1 y , in an interview based entirely on 
pictures. This test identifies not only the person who can ans- 
wer appropr i a tel y and speak correctly, but also the person who 
understands sufficiently to respond with the correct information, 
but whose structural language patterns and grammar are oftfen 
i ncor r ec t . ^ 

Problems of Interviews 

Any test that measures speaking ability requires administration 
time. Ea.ch student is tested individually. Most often interviews 
are used to measure speaking ability and seldom reflect more than 
guesswork. Most oral interviews tend to have rather low reliability 

^^ncreasing reliability is time-consuming since it requires . 
— ^at each interview be graded by two or three examiners, using a 
subjective rating scale. These subjective scores are then 
averaged to arrive at a more equitable grade for each individual 
tested (Harris, 1969, p. 85). Interviews requiring set standards 
of scoring and more, than one exa^miner are seldom possible in any 
adult program., ^ . 

For placement purposes , counselors and administrators 
generally rely on .a kind of guesswork that poses as an oral inter- 
view. These. i nterv i ews" are usually conducted in English^ with 
varying degrees of success in esta bl i sh i ng rapport and communica- 
tion. Often the student has a willing friend or relative who 
translates, helps, or even answers for him or her, thereby intro- 
ducing„a third variable into the "guesswork.** If the interview 
Is conducted in the student's first language, placement may be 
based on talking a bout English, rather than actually speaki ng 
English. ' 

The llyin Oral Interview, with Its set pattern of scbring. Is 
more consistent. The interview requires only Otpe examiner per 
Individual tested. Thl-s shortens the length of time usually re- 
quired for an interview. A friendly,' relaxed person who under- 
stands the test, and can read in a conversational way can give 
the test; and most educated, objective people can score it. Many 
pa raprof es s i ona 1 s and aides have been h^lghly, successful in giving 
the Interview. g 
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Reliability figures on the test itself are h i g h , a It houg h no 
reliability study has been'made on persons scoring the test, The 
test is not too difficult for students v;ho speak some English, and 
is designed to prevent frustration and fear of failure. 

Defined levels of oral proficiency are emerging, Further 
studies on the first edition, scorer reliability studies, and na- 
tive speaker samples are needed, 

Backg^round on Test Development of the Interview 

Beg i nn i ng ed i t I on s of the test wer e adm i n i s t er ed to students 
in migrant worker adult ESL programs in Illinois, and to students 
in adul't^ESL and special vocational programs in urban areas of 
California, Later, in order to develop an experimental edition, 
more than 700 students in adult ESL courses a nd ' voca t i ona 1 programs 
In San Francisco were tested. These students ranged in age from 
18 to 63f and came from Asian, Latin American, European, and 
Middle Eastern countries. Some had worked with native speakers; 
others had experienced little contact with oral English except in 
class. Educational levels in the students' own languages varied 
from fourth grade through completion of college. Length of time 
in the United States ranged from six montf^s to 20 years.* 

For the first edition, research was based on the testing of 
200 students in adult ESL classes in San Francisco, as ^we 1 1 as \ 
over 700 students in vaVious other programs throughout Canada 
and the United States, The samples included students in college 
level i nt ensj ve Eng 1 i sh classes for foreign students, as well as 
students in manpower training, p^rivate industryi and elementary 
or high school ESL programs. As expected, there was wide vari- 
ance in goals, ages , educ3"t ion language backgrounds, length of 
instruction in English, years spent in the United States and 
extent of contact with native speakers. 

Research and field testing of an experimental ed i t i on pu b 1 i s hed 
In 1972, indicated a need for a. shorter administration time, a 
quicker method of scoring, revision of some items and pictures, a 
reordering of the more difficult items as well as a need to pub- 
lish the manual of instructions in the test booklet itself rather 
than in a separate book which was. easily lost. 

Description of the Interview (First Edi.tion^^ \ 

There are two forms; of the test, entitled, respectively, Bill 
and Tom,, The examiner uses one of these forms with corresponding 



Assistance was provided by many peop 1 e- - r ea 1 1 y too many to 
mention. Some of the most complete studies took many hours--far 
more than were necessary for the projects M.A, candidates were 
required to do, I would especially like, to express my apprecia- ' 
tion to Doro t hy Da n I e 1 son , who directed ^the work, and to the 
following for great efforts in hejping me with the research: Terrance 
Carlman, Joan Hanford, Judith Laws ^^yem, Valor.ie Howard, Louise 
* McDonald and Leanna Rosenbaum, 7 



-5- 



pictures. In a relaxed, conversational settTng, he reads ct>n- 
trolled Items about pictures In the book and records the student's 
score. The student sees only the pictures. Time limjts are flexi- 
ble since in the first part the examiner terminates the test at 
the frustration level--that Is, when a student Is unable to under- 
stand a number of items.- in succession, - 

The examiner scorfes Responses immediately by simply circling 
as follows: 



© 



1 - (o^ The answer is Inappropriate or unintelligible (Grammar 
and structure may or may not be correct) . 

{l3 • 0 The answer is appropriate and Intelligible (There are 
one or more fiistakes In grammar or structure), 

1 " 0 The answer Is appropriate and Intelligible and the 
g ramma r is perfect (no mistakes, even little ones). 



Wher>v administration time is even mo re restricted, the exam i ner 
can use only 30 of the most discriminating ItemSv^. These 30 Items, 
which are marked, were selected from the original 50 items on the 
basis of an item analysis study of high and low scorers In a 
sample of 100 students. 

Test Adapt Ion for a Mass Listening Test 

If there are not enough examiners available' to give the 
Interview on a one-to-one basis, and if students 3re. able^ to write 
their own responses (even if i hco r r ec t 1 y s pe 1 1 ed ) , it is possible' 
for a .teacher to give the Interview to a class as a ma s s 1 I s t e n I ng 
test. - Individual student booklets containing only pictures can 
be made by duplicating the picture's pages only. The teacher reads 
each It em, and students look at 'the appropriate picture page and 
write their answers. 

Students" never see any written form of the Items either in 
the Oral Interview or in the mass listening test. Teacher s score 
written answers with the two point system. Spelling Is not graded, 
and the student is told in advance that it will, not be graded. 
However, the teacher may still want to make ah overall rating of 
astudent'sabilltytospell. 

Orientatton to Oral tnterview 

As an orientation to the interview, the examiner s-hows the! 
student the pictures (see Table 2 next page) and tells the stud'^nt 
that the pictures a^e all about the same man. He shows him whe/e 
the time is Indicated and explains the system showing the man's* 
activities for Last Sunday (a weekend day),| Today and Tommorrow 
(as weekdays), anT"tells a story about the man's activities in the 
pictures. (The alternate booklet has Yesterday and Today as 
weekdays, and Next Saturday as a weekend day . ) The examiner checks 
to see that the student understands this system before he begins 
the test. g 
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Sample Items from^each level of instcuction have been selected 
and arranged according to difficulty. Earner Items include 
questions like "Who Is this man?" and "What Is he doing In this 
picture?" Later questions include such Items as "If his televi- 
sion Is broken,' what do you think Bill will be doing?" To elicit 
questions in the first part of the I nterv I ew, t he exam i ne r s hows 
the student a picture in the "past" series and tells hjm to.ask a 
question about the picture. As pne of the Items In the last part, 
the examiner shows the student a picture and tells him fco ask a 
question ^sing the word wh t ch , The next item In the series requires 
the student to answer his own question, 

i: ' ' 

Although a conversational tome Is maintained throughout the 
intervie..w, the student is a s ked to a n swe r in complete sentences. 
He often r e s_RO nd s w I t h a quick word o^r phrase, but I s prompt ed to 
give a more complete answer so that structural accuracy can be 
properly assessed. He Is encouraged to ask that questions or 
instructions be repeated unless It becomes obVious that he Is asking, 
for repetitions only to gain time and that he doesn't understand, , 
In that case the examiner goes on to another question. 

The length of the Interview varies with a student's pro- 
ficiency. When the Items become too difficult for the student, 
the examiner repeats a simple instruction or question, to which 
the student can r.espond, before terminating the interview. In 
this way the student is lift with a feeling of success. 

Sc ^ r i n^ Examp 1 es / 

To see more clearly how scoring works, look at the following 
sample items and poss i bl e student answers (for the pictures on 
which these items are based, see Table 2, page 7), 

Exami ner - - Candidate Score 

8. How does Bill go to school? He go walking to 8. 2*(j}-0 

school p 

9. Where does he eat his lunch They eat after 9. 2-1-^ 

on week-days? school, 

10. When does he eat lunch on |s at 11:50 min- 10, 2-0^0 

weekdays? utes to 12 and 

' ^ 1 ^ a ha 1 f . 

11. |ls he going to be eating Oh, no, 

lunch tomorrjow at 12:15? 

Good. Tell me a complete No, he Isn't. 11.(2)-l-0 

sentence . 

In number nine, where the i nformat ion wa5 np^ correct or 
appropriate, structure and grammar were not scored. In number ten, 
the student omitted jj^, or lunch , and made several errors in the 
time phrase; but no vyords are out of order, and a variation to the 
answer could be "It (meaning lunch) Is at 11:50, or from 11:50 to 
12:30." J^O 
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A student is not rated lower for accented pronunciation or 
for unusual i ntonat ion- patterns , as long as he is intelligible and 
his answer appropriate. For instance, on an early part of the 
test the exar^ner might point to a picture of the man sitting in 
front of a TV and ask, '*What is Bill ^doing in this picture?" If 
the student repli es , '^He washing TV.'' he wou 1 d , be .g i ven points 
for J nf ormat ion^ H i s mistakes are in pronunciation and verb 
form; he did say Ps or pUjt an _^s^ on he. That 'error is struc- 

tural. Of ji0l4rsfe, no one ever ''wasfTes" TV, but everyone would 
undersrTarid him in this context. The score on this item would be 
J^. The main concerns are: ' 

1. Can a native speaker of English understand him? 

2. Is his information cor rect accord i ng to the context? 
3t Are the structural patterns correct? 

P I a cemen t - '■^ 

Complete information on how students should be placed, what 
their oral levels of performance are or will be after a g'iven^per- 
lod of time, or how thejse levels of performance relates to job 
iiMlls, cannot be availjiable until the-first edition has been pub- 
lished and more r es ea r dh comp 1 et ed . .However, a paJLtern is emerging 
f.nd guidelines are provided for placement into the ESL levels of 
instruction used in Sa n ' Fra nc I sco (ESL Master Plan Phase • I I , 1 972) *• 

Each program is encpuraged tp test its students, and to use 
the gu idel i nes suggested in the interview until^the individual pro- 
gram can set its. own realistic entry level and terminal scores 
for given amounts of time. In this way, mos t j s t uden t s or workers 
who attend programs r egu 1 a r 1 y can reach a rea|listic proficiency 
level established for the end of: the course or training period. 

Length of Course Instruction 
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There are a number of factors? that affect t ime necessary to 
complete a particular level: age, number of dependents, prior 
to exposure to Eng 1 i sh / 1 i teracy in the native language, type and 
nature of the native language, educational background and even 
marital status affect success in language p r-of i c i e ncy cou r s es . 
Appa r ej njLLv^ no cO rr e-l-at i-on has been -found between a student's sex 
and his^ ability to learn a language; nor between economic back- 
ground and language learning, or length of. stay in the. United States 
and language learning (City of Oakland, 1 , p. 25). Other well 
known factors that affect the rate of learning or time spent in a 
particular ESL ^level of proficiency include student's motivation,' 
the climate of the classroom, and the teacher's understanding of 
Individual students' needs as well as ESL ledrns' specific needs. 

At Alemany adult center where the EPT tests were developed,- 
the^ number*" of hours necessary f o r comp 1 et i on of a particular level 
of instruction varied from 350 to 500 hours. Some students com- 
ple.ted two levels of instruction in that same time span, while 
others spent from 700 to 1,000 hou r s comp 1 et i ng only one level of 
Instruction. Not all students come in with no proficiency and stay 
untUithc end of the advanced progra\m. Sixty to seventy percent 
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of .the students enrolled are in the First two begir/ning levels, 
twenty to twenty-five percent in the intermediate levels, and the 
rest in the ad vanced 1 eve 1 s . It is at the intermediate levels 
that students want to combine theTr English instruction with other, 
educational or training gcials. They leave Alemany Adult School 
(Primarily Engljsh Language P rof I c i e ncy Schoo 1 ) for the following 
reasons: 

-To enroll in basic educat ion subjects in other schools when 
*their general educational level i)S below fifth grade in any 
1 anguage 

-To enroll, i n voca t i o na 1 1 y oriented programs or^ub^idized 
programs 

-To work at a job^ requ i r i ng minimal language skills in English 
j -To^ enter junior college special prtogr^ms 

yio enroll in college EFL intensive E ng 1 i s h xou r s e s for 
' entry into four year college a nd u n i ve r s i t y work ' 

Test Statistics and Norms 



a ppec t s 
studies 



Research studies on the experimental edition have been 
voluntary, with different examiners interested in different 
of research. Reliability figures ar:/fe high, and correlation 
with other pleasures of aural prof i 0i e ncy.s how a marked relation- 
ship. There is a 1 so a relationship between test re^'sults and 
teachers* opinions of students' communicative ability. This . corre- 
lation is considerably higher for students In adult program ESL 
than for those in college Intensive programs. The 3G item test 
and the quicker two point scoring system appear to pbe as relia^ble 
as the total '^test of '50 Items and the longer four point scpring 
system. p ^ 

The interview reflects better placement in the earlier levels, 
where aural/oral skills are stressed, than in the advanced levels. 
It see|tis su I ta bl e f or use in the followint types of programs: 



-Adult ESL and ABE readiness programs 
-Junior college lower ESL levelsX 



\ 



-Intensive EFL courses preparing students for four yearcolleges 

-Vocational programs, federal training projects and private 
compa n I es wo r k i ng o n u pg r a4 I ng m i no r ! ty emp 1 oy ee s ' ' 

The interview is too'^easy, however, for students already 
taking regular college or university work. 

• \ ■ • 
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Four Studies 

I . Using the 50 item exp^er 1 menta 1 edition and long scoring system. 
Description of the four r/eference groups 

A. Students in two adult center day ESL programs in San Fran- 
cisco. Language proficiency and educational backgrou nd/, 
as v/ell asMength of / English instruction and time in the — 
United States varied v/idely. Ages ranged from 18 to 75. 
Students we replaced into six levels of adult ESL instruc- 
tion by' the EPT Placen\jsnt tests and by teachers' recommen- 
dations. The" students in the vocational 200 class were 

' selected by their primary goal of finding a job in 

addition tjo their ESL level. Interviews we re given in 
the middle! of the cours.e. The regular level interviews 
were conducted by fiv^e graduate students in a TEFL 
' Ma s t e r ' 5 p rog ram . The vocational 20t) interviews were 
conducted by a/ teacher/counselor. 

/ B. French sp^eaking students in Canada in'^an intensive English 

program preparing for college and university work. 
Students had comp 1 e t ed secondary school and had had three 
to four years of formal, traditional English instruction. 
Ages were 18 to 25. Placement into tv/o levels of instruc- 
tion were based on scores obtained from the MTE LP and the 
ELI Aural Achievement Test . Interviews were given, during 
\ the last two weeks of a six week aural/oral program by 

an instructor wi'th an M.A.- in TEFL.^ 

C. Foreign students in a full time intensi^^ language training 
program^ i n Ca 1 i f or n ia . All had completer! secondary school. 
Language background and length of previous English in- 
struction varied widely. Placement into five levels of 
instruction was based on scores received on TOEFL. Inter- 
views were given during the middle of the program by two 
gracluate students enrolled in a TEFL M. A. program. 

0. Employeesina large New York on-the-job upgrading program. 
Second dialect speakers as well as speakers of many 
different foreign languages were included in. the group. 
All had had good work records, but had not b^en promoted 
because of problems they had in communicating with the 
public. A fev/ were born in the United States. Some had 
lived here for many years. . Interviews were given by 
teachers at the beginning of a ten month training program. 
■ . ■ ■ " ..li 

Mean scores, standard deviations, reliability coefficients and 
standard errors of measurement for thefour reference groups. 

Table 3 presents data for- the tests tjaken by the four reference 



groups.. They show the relative difficulty 



(Mean. and Standard Deviation), a comparisor of one group with 



another (Means), the degree of cons fstency 



the limits within which an individual's test sco r e may va ry from 



his true score (SEm) . Reliability coeffici 



of the test for the groups 



of measu rement (r),. and 



e n/t s we r e cbmpu ted in 



various ways. Kuda r ""R i cha rdson ' s formula and the short^cu^ 

< . -n- 13 



method for ^eacher made tests d esc r I bed by Ha r r I s were the most 
ffequent 1 y used (Harri^ 1969i p. H^). 







TABLE 


3 perfect score 


■= 200 












Mean or 








G rou p 


Level 


Number 


, (^Median) 


SD 


R 


SJEm 


A 


TOO ' 


21 


22* 


17 


.95 


3.7 




200 


20^ 


75* 


'♦3 


.95 


9,5 




V200 


23 


76* 


40 


.95 


8.74 




300 


-21 


90* 


k2 


/ .95 


9.24 




400 


3V 


133* 


20 




500 


33 


UO* 


21 


.91 


6.5 




600 


30 


]kS* 


is 




B 




23 


123 




.95 


^9.86 


C 




/ ; -78 . 




50 


,98 


6,14" 


D 




93 


\ 1 56 


33 




8.03 



VaHdfty study usin^ Groups A, B and C 



Some small studies have been done comparing students' scores 
on the interview with other means of evaluation. At the end of 
the Vocational 200 course in Group A, st,udents took three tests 
that measU|red aural comprehension, (Lado 1957, NiKon 1970 and the 
Interview) as well as EPT A/B. Teachers and students ranked each 
student for conversational ability before the tests were adminis- 
tered. A comparison off students' scores In levels 400, 500 and 
600 were also made on EPT G/H. Students in Group B took MTELP 
and the ELI Aural Test while students 1 n, C took TOEFL and were 
rated for their conversational ability by{ their teachers before 
the interviews were given. Correlations \yiere computed by uging 
the Rank, Order Difference method and the Ip.earson Product Moment. 
Table 4 shows the results of the correlation studies, (Number in " 
each sample appear In the parenthesis under each correlating figure. 

TABLE 4 • 



Group Level - Lado N i xon 

A V200 .-72 .80 

(15) (16) 



St 



EPT TOEFL 



ELI 



MTELP 



77 .7/4 .85 
(17) (/l) (16) 



400/500/ 

600/ 



.41 

(62), 



.56 

(23) 



.67 

(23) 



.31 
(78) 



.60 

(78) 



2 • Using a r ev i sed • exper i men ta 1 edition 
ma ss 1 i s ten i ng test , 



\ n 



an adaptation as a 



Fifth-six items on the r ev i s ed expe r i me n t a 1 interview were 
given to students similar to Group A above by the author at the 
end of each course. The interviews were first scored by the method 
used In the experimental test (four points per item) and then the 
short system recommehded In the first edltlon(two points per Item). 
Through 1 1 em a na 1 y s i s , the best 50' revised Items and then the 30 
most discriminating Items out of those 50 were selected. The tests 
were re-scored to d et'e rm i ne co r r e 1 a t i on s between items and scoring, 
as well as r e 11 a b 11 i ty / mea n s , standard deviations and standard 
errors of mea su r emen^t . Tables 5, 6 and 7 show the results of these 
studies. 



TABLE 5 

Medians on the 56 Revised Item Interview 



^-po i nt scor i ng 
^(perfect score = 22^) 



Level 


N 


Median 


200 


21 


1 1 1 


300 


50 






32 


\7k 


5oo/6oa 


20 


185 



2-po i nt scor i ng 
(perfect score-l 1 2) 

Median R 



50 
65 
76 
83 



TABLE 6 

Means, standard deviations and standard errors of measurement for 
re-scor ed 50 items and 30 items. No.: 102 students in levels 300, 

AOO and 500/600 . Group A. 



Number of 


Scoring 


Total Possible 






i 
t 


1 1 ems 


Sy- 


; t em 


Points- 


R 


Mean 


SD 


50 


i» 


Pt. 


200 


.96 


1 5 . 0 6 


29.89 


50 


2 


Pt, 


100 


.92 


65.^*3 


1 5.50 


30 


i» 


pt . 


1 20 


.SI* 


81 .82 


19.37 


30 


2 


pt. 


60 


.86 


36.i.5 


9.51 



SEm 

5.99 
3.3'» 
.72 
3.61 



. TABLE 7 

'""^ between numbers of items and scoring systems. Number: 
102'students in levels 300, '♦OO and 500/600 in Group A, Tnterviewed 

at the end of each level. 



50 with 30 item s 

k point scoring with 
2 point scoring 



h point scoring 

.93 
50 Items 
.96 



2 po I n t scoV i ng 

30 i terns 
.97 
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Using the first edition 30 item option with' the two point scoring 



y s t em , 



Description of referenc-e group 



Students in three different 
programs in an Eastern day and ni 
to 76. Students had many differe 
students In one pro^gram were all 
of t{>s5 students in the other two 
there were large numbers of Korea 
programs as well as speakers of a 
Education levels In the students ^ 
col lege and university cpmpletlon 
ranged from three days to ten or 
the test at the beginning of the 
date in the study. 



f edera 1 1 y funded 
ght school . Ages 
nt 1 anguage backg 
Spanish speakers 
prog rams were Spa 
n s and Russians i 
wide va r i ety of 
own 1 a nguag e va r 
Years spent i n 
mo r e years. T^ac 
programs. Table 



job training' 

ranged from 18 
rou nd s . The 
a nd the ma jor I ty 
n I s h . However , 
n the other 
languages, 
led from 0 to 

the United States 
hers adml n I stered 
8 presents the 



Numbe r 



170 



TABLE 8 * perfect score=60 
Mea n S D R 

20.55 14.17 .92 




^ » Using part of the 50 items In the revised edition with the two 
point system of scoring (perfect score-63) in an adaption of the 
Interview as a mass listening test. 

Description of refer ence group . 

Japanese high school and college students and Japanese English 
teachers In a special four week course at a California state^^uni* 
versity summer program. Ages ranged from 15 to 28. Years of 
English study ranged from 3 to 10. Interviews were administered 
by two teachers at the beginning of the program. Students took 
both the interview and the intermediate forms of the STEL test, 
(Best, 1976). Results of the study are in Table 9. 
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Test 
ICI 

STEL I 
Concl us Ion 



Number 



63 
63 



TABLE 9 - perfect score=62 



SD 




10.96 



R 


SEm 


.92 


A. 02 


.88 


3.80 



Correlation 

/ 

IOI\ &,ySTEL 



It has taken many years for this interview to reach its present 
stage of readiness for a first edition. Much more research can be 
done to help students, employers and program planners.^ It is a 

IG 



0 



new Idea., based on a controlled, picture orfented situation. It 
asks examiners to'score only when appropriate Information has been 
communicated, ^he examiner does not penalize for accent If the 
Information Is understandable in context. He accepts any variations 
in structure and/or grammar that educated native speakers v;ould 
use in the context . 

While the test is easy to administer, examiners must become 
familiar with its uniqueness. It Is hoped that the interview 
will be useful to ESL prog rams, ,ba s I c education programs, industry, 
and employment agencies -In more objectively assessing foreign 
and second language -speakers ' oral levels of English proficiency. 



1'^ 
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